Scenery from the Top: Study of the Third Generation Squarks at CERN LHC 
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In the minimal supersymmetric standard model (MSSM) properties of the third generation 
sfermions are important from the viewpoint of discriminating the SUSY breaking models and in the 
determination of the Higgs boson mass. If gluinos are copiously produced at CERN LHC, gluino 
decays into tb through stop and sbottom can be studied using hadronic decays of the top quark. 
The kinematical endpoint of the gluino decays can be evaluated using a W sideband method to 
estimate combinatorial backgrounds. This implies that fundamental parameters related to the third 
generation squarks can be reliably measured. The top-quark polarization dependence in the decay 
process may also be extracted by looking at the b jet distribution near the kinematical endpoint. 

PACS numbers: 12.60.Jv, 14.80. Ly 



The minimal supersymmetric standard model (MSSM) 
is one of the promising extensions of the standard model 
(SM). The model requires superpartners of ordinary par- 
ticles (sparticles) , and LHC at CERN might confirm the 
existence of these new particles [1]. Since the sparti- 
cle masses are related to the SUSY breaking mechanism, 
measurement of the masses provides a way to probe the 
origin of SUSY breaking in nature. 

The masses and mixings of stops (£1,2) and sbottoms 
(61 2) are sensitive to the flavor structure of scalar masses. 
First, the diagonal masses in the stop and sbottom mass 
matrices, mg 3 , m t R i and m b R ' are predicted to be less 
than those of other squarks in the minimal supergravity 
(MSUGRA) model [2] because of the Yukawa RGE run- 
ning effects. Some SUSY breaking models, such as the 
flavor U(2) model [3] or the decoupling solution [4], and 
the superconformal model [5] for the SUSY flavor prob- 
lem, have also special imprints on these parameters. The 
?£-?R-Higgs trilinear coupling A t at the weak scale has a 
large coefficient proportional to m t , resulting in a large 
left-right mixing of stops; ra 2 LR = m t (A t — /zcot/3). In 
the MSUGRA A t is proportional to the universal gaug- 
ino mass M at the GUT scale Mgut, and insensitive to 
the A parameter at Mgut [6] . Indeed, this is one of the 
robust predictions of SUSY breaking at Mgut- These re- 
lation is not guaranteed if the SUSY breaking mediation 
scale is much smaller than Mgut- It should be stressed 
that the stop masses and the mixing are very important 
parameters to predict the light Higgs mass [7]. 

It is possible to study the stop and sbottom at LHC 
through the gluino (g) decay modes listed below. 



In previous literatures [1, 8], the third generation 
sfermions are often studied using the mode I) (bbl + l~ 
channels). This mode is important when X2 has substan- 
tial branching ratios into leptons. Measurement of the 
kinematical endpoints of the signal distributions tells us 
the sparticle masses. Unfortunately, the branching ratios 
could be very small, and this mode is insensitive to the 
stop. We tried to study the mode II) in Eqs. (1), but the 
result was unsuccessful because of the small branching 
ratio in the MSUGRA. 

In this paper we try to measure the endpoints of the 
modes III) and IV) in Eqs. (1). The decay modes are 
expected to be dominant in the MSUGRA since Xi ^ s 
likely to be SU(2)i gaugino-like and Br(bi,ti — > Xi) 
could be as large as 60%. We focus on the reconstruction 
of hadronic decay of the top quark, because the distribu- 
tion of the tb invariant mass m t b makes a clear endpoint 
in this case. 

The parton level distribution of the tb final state invari- 
ant mass is expressed as a function of wig, , mg i , and 
chargino mass m~-: dT/dm t b oc mtb, and the endpoints 
M t b for the modes III) and IV) are written as follows; 
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Note that the endpoint of the final state tbxi should be 
sensitive to both t\ and b%. 

In order to demonstrate the endpoint reconstruction, 
we take an MSUGRA point with the scalar mass m = 
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TABLE I: The sparticle masses in GeV and the total SUSY 
cross sections in pb for the parameter points studied in this 
paper. 



lOOGeV, the gaugino mass M = 300GeV, the A param- 
eter -300GeV at the GUT scale, tan/3 = 10 and fi > 0. 
This corresponds to the sample point Al in Table 1. The 
masses and mixings of sparticles are calculated by ISAS- 
USY/ISASUGRA [9]. The Monte Carlo SUSY events are 
generated by PYTHIA [10] using the masses and mix- 
ings, and then passed through a fast detector simulation 
program for the ATLAS experiment [11]. Jets are recon- 
structed by a cone-based algorithm with AR — 0.4. The 
b and t tagging efficiencies are set to be 60% and 50%, 
respectively. 

In our study we apply the following selection for the 
tb signal; 1) £™ iss > 200 GeV, 2) m eff > 1000 GeV 
(m cff = E™ iss + EaH^T*)' 3 ) tw0 and onl y tw0 Hets 
with pt > 30 GeV, 4) 4 < nj e t < 6 (nj e t, number of 
additional jets with px > 30 GeV and \r]\ < 3.0). In 
addition, events with leptons are removed to reduce the 
background from tt production. At this stage the number 
of remaining tt events is rather small, about 10% of the 
remaining SUSY events for the point Al. 

To reconstruct the hadronic decay of the top quark, 
we first take a jet pair consistent with a hadronic W 
boson decay with a cut on the jet pair invariant mass 
rrijj] \m,jj — mw\ < 15GcV. The invariant mass of the 
jet pair and one of the b jets, m&jj, is then calculated. 
All possible combinations are tried in an event, and the 
combination which minimizes \rribjj — rnt \ is chosen. The 
jet combination is regarded as a top candidate if [m^j — 
m t \ < 30GeV. The energy and momentum of the jet pair 
are then rescaled so that rrijj — mw- 

The expected tb endpoint is not clearly visible in the 
mtb distribution shown in Fig. 1(a). As there are 7 to 8 
jets on average in a selected event, events with a fake W 
boson (and a fake top quark) dominate the distribution. 
The distribution of the fake W events is estimated from 
the events that contain jet pairs with the invariant mass 
in the ranges A) \rrijj — {my/ — 15GeV)| < 15 GeV and B) 
\m j:j -(m w +l5GeV)\ < 15 GeV; 'the W sidebands'. The 
energy and momentum of the jet pairs are then rescaled 
linearly to be in the range \m,jj — m\y\ < 15GeV. The 
fake top candidates are reconstructed from the rescaled 
jet pairs and b jets in the events. 

The estimated background distribution is shown in 
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FIG. 1: (a) The signal mtb distribution for the sample point 
Al in Table 1, (b) the estimated background distribution from 
the sideband events, (c) (a) — (b), and (d) the m t t distribution 
for the modes III) and IV) in Eqs. (1), and a decay mode 
irreducible to the mode III). 



Fig. 1(b), which is obtained by averaging distributions 
from the sidebands A) and B). The estimation is based 
on an assumption that most of the jets in the events 
do not have significant correlation with the b jets in the 
events. The estimated background distribution is sub- 
tracted from the signal distribution in Fig. 1(c). The 
estimated correct signal distribution (c) shows the better 
endpoint compared to (a). Fig. 1(d) is the same distri- 
bution as Fig. 1(c) but for the events which contain the 
mode III), the mode IV), or a decay mode irreducible to 
the mode III); g -> hb -> ii(W6) -» bx[(bW). Note 
that if (bW) has an invariant mass consistent to a top, 
the decay is kinematically equivalent to the mode III). 
Fig. 1(d) shows the expected clear edge at the right place 
(M tb (III) = 476GcV and M tb (lV) = 420 GeV), demon- 
strating that the sideband method works well. Here, the 
number of the generated SUSY events is 3 x 10 6 , which 
corresponds to an integrated luminosity of 120fb _1 . The 
plots do not include the SM backgrounds. 

Note that the signals from the modes III) and IV) in 
Eqs. (1) are significant in the total selected events. We 
fit the total distribution shown in Fig. 1(c) by a simple 
fitting function, which is described as a function of the 
endpoint Mf£, the edge height h, and the smearing pa- 



rameter a from the jet energy resolution. We assume that 
the signal distribution is sitting on a linearly-decreasing 
background. The Mf£ is compared with the weighted 
endpoint M t ™ defined by 
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FIG. 2: (a) A fit to the nitb distribution (point Al), and (b) 
comparison of 
in this paper. 



comparison of M tb t and M™ b for the sample parameters given 



where Br(lll) and Br(W) are branching ratios for the 
modes III) and IV), respectively. The fit is shown in 
Fig. 2 (a). We obtain Mf b % = 443.2 ± 7.4 GeV, which is 
consistent with M% = 459GcV. The M$ changes mod- 
erately when one changes the m t b range used for the fit. 
We choose the range so that the significance of the height 
S = h/ Ah is at maximum. For the fit shown in Fig. 2(a), 
S(max) = 196.9/15.2 = 13.0 is obtained. 

In order to check the availability of the endpoint mea- 
surement, we study twelve sample points in total, includ- 
ing the previous point, shown in Table 1, and compare 
M$ and M%. We choose two reference MSUGRA points 
as Al and A2, where m = 100 GeV, M = 300 GeV, 
tan/3 = 10, n > and A = ^300 GeV. We also study 
points with different mass spectrums from the MSUGRA 
predictions; two points with gluino masses heavier than 
the reference points, (Gl, G2), and two points with mod- 
ified stop masses (T1,T2). Furthermore, we include the 
MSUGRA points selected from [12] (B,C,G,I) and two 
non-SUGRA points El and E2 where the gluino decays 
exclusively into t\. The result is summarized in Fig. 2 
(b)[14]. The error bars represent the statistical errors 
for 3 x 10 6 SUSY events at each point, and the system- 
atic error of the jet energy scale (1%) is not included 
(see Table 1 for SUSY cross sections). This plot shows 
an impressive linearity between the expectation and the 
MC fits, although M$ is systematically lower than M t ™. 
This is reasonable since some of particles are always out 
of the cone to define jets. This effect may be corrected 
by comparing distributions with different jet definitions. 

Another uncertainty may come from the jet fragmen- 
tation. If events are generated by ISAJET for the point 
Al, the reconstructed endpoint is smaller by 10%, and 
the number of events after the sideband subtraction is 
smaller by a factor of 1.5. The difference comes from the 
different jet fragmentation schemes. ISAJET radiates 
more soft jets for a parton, resulting in more background 
and smeared endpoint distribution. The event genera- 
tors must be tuned carefully to extract the kinematical 



information from the signal distribution. 

We now discuss the physics that might be studied with 
the tb endpoint measurement. 

We cannot determine all of the relevant mass param- 
eters from only the tb endpoint measurement, since the 
endpoint M t b depends on m§, , and m^. Thus, the 
study of bbl + l~ final state would be important to single 
out the possible t and b contributions to the tb final state 
and to proceed to a model-independent study. For ex- 
ample, let us assume that errors of the endpoints Mbui 
and Mui are 10 GeV and that of the endpoint M^i is 
30 GeV in the measurement. Here, bi is one of the two 
b jets for which the invariant mass mui is larger. When 
we generate uig , m^, X2, an( i Xi randomly around the 
reference point Al fixing the endpoint Ma (which is ex- 
pected to have a very small error), and require A\ 2 = 
J2i( M i ~ M^f/AM 2 < 1(9) (i runs over the possible 
endpoints), the deviation M t t(IV) — M t ^ 1 (IV) is always 
less than 15(45)GeV. For the point Al, M t6 (IV) = 420 
GeV and M% ~ 460 GeV. The difference of M tfc (IV) and 
M t ™ therefore may be statistically distinguishable. 

The measurement of the SUSY breaking parameters in 
different sectors might reveal an overall inconsistency of 
the SUSY breaking mediation models. The distribution 
of the invariant mass formed by combining the highest 
Pt jet and a same-flavor and opposite-sign lepton pair 
(jll channels) is sensitive to rriq and mr, and this may 
lead to the determination of m and M in the MSUGRA 
[1, 13]. Once M and m are fixed, they strongly constrain 
the endpoint M% in the MSUGRA - by comparing it 
with the measured value, one should be able to check if 
or nig are consistent to the MSUGRA predictions. 

Note also that the formulae of M t b or M^ui involve m g , 
while the first generation squark mass is lower bounded 
by rrig in the model. If mg ^> rriq is established by com- 
bining the squark mass scale determined through a jll 
analysis [1] and the analysis of the final state involving 
b jets, we can show that some new physics should occur 
below the scale where m~ < 0. Note that, in the points 
Gl and G2 in Table 1, where the gluino mass is increased 
by 100 GeV from the MSUGRA predictions, m 2 becomes 
negative at the GUT scale. We study the jll distributions 
for the point G2 in a similar way as given in Ref. [13] and 
find that the jll endpoints are successfully reconstructed. 
Therefore the information on m q should be obtained in 
this case. 

In the framework of the MSUGRA, the measurement 
of M t b is sensitive to the GUT scale A parameter. This 
effect is large when M x A < as can be seen in Fig. 3. 
Here we take M ~ m and m = 230 GeV, and vary A 
so that \A\ < 3m. The M% and m~ ti vary by 50 GeV 
and 150 GeV, respectively, and the changes are again 
detectable. Note that the x° decay into 11 is closed in this 
case, therefore the information from the bbl + l~ channels 
is not available. If m = 100 GeV and A is varied from 
-300 GeV to 300 GeV, M% and m h change by 30 GeV 
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FIG. 3: Dependence of M tb , m^, and m- bi on the GUT scale 
A parameter in the MSUGRA. 
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FIG. 4: The parton level distribution of m bb for point Al. 
The two histograms show the distribution for the event with 
M ti , (III) - 50GeV < ma < M ti ,(III) in cases ti = Ir and 

tl = tL- 

and 70 GeV, respectively. 

Finally, we discuss top-quark polarization dependence 
in the gluino decay. Naturally all top quarks coming 
from g, ti, and b\ decays are polarized, depending on the 
sfcrmion and chargino mixings. For example, when t\ is 
mostly right(left)-handed stop, t of g — > tt\ is t R ( L y This 
propagates into the average top-quark hclicity, if the top 
quark is relativistic enough in the gluino rest frame. If 
the tb invariant mass is close to the endpoint M t b of the 
mode III) in Eqs. (1), the t and b go to the opposite direc- 
tion in the gluino rest frame. Because the bottom quark 
from the top-quark decay tends to go to the opposite di- 
rection to the top-quark helicity, the distribution of the 
invariant mass mbb for events with mtb close to Mtb(III) 
depends on the average top-quark helicity. The parton- 
level distributions of mjj are plotted in Fig. 4 for the 
point Al. The solid (dotted) curve shows the distribution 
for the events with M t6 (III) - 50GcV < m tb < M t6 (III) 
in the case of t\ = Ir (ti = t L ). One can read from 
Fig. 1 that roughly 200 signal events are available near 
the endpoint. The statistical difference between the two 
distributions is 3 a for 100 signal events without taking 
care of the background [15]. 



In this paper, we try to reconstruct final states which 
consisting of hadronic jets at LHC. This was considered 
difficult due to the large combinatorial background, but 
is overcome by a IF sideband method developed to esti- 
mate the background. We reconstruct the tb final state 
from the event containing two b jets. The reconstructed 
endpoint provides us an access to the gluino and the third 
generation sparticle masses without relying on the decay 
modes including leptons. The correct reconstruction of 
the events also allows us to consider the top-quark polar- 
ization dependence of the distribution. This information 
is important to determine the radiative correction to the 
Higgs mass, as well as the origin of SUSY breaking. 
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